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INTERPOLATION FOR FUNCTIONS 
OF SEVERAL VARIABLES 

CHAPTER I 

GENERAL INTERPOLATION 


1.1 INTRODUCTION 

The usual method for interpolation of functions of several variables has 
been to iterate the interpolation process for each variable taken separately. 

By its very nature, this process has forced the base points to be located at the 
corners of a rectaiigular or triangular grid. These are, however, generalizations 
of some of the class ical interpolation formulas to much larger classes of points. 
This report is a summary of some of the algebraic techniques in interpolation 
theory with particular emphasis on the application of these techniques to func- 
tions of several variables. In particular, we discuss what appears to be the 
most natural generalizations of the familiar Lagrange formula, Newton divided 
difference scheme and Aitken interpolation scheme to functions of several 
variables. We shall show chat both the Lagrange formula and Newton formula 
can be derived from more general theorems on finite dimensional vector spaces. 
When applied to functions of several variables, these formulae are applicable to 
arbitrarily located base points as long as the determinants appearing in the 
denominators are not zero. On the other hand, the Aitken scheme does not have 
a generalization to arbitrary finite dimensional vector spaces. In this case w r e 
present an iteration scheme, due to Thacher and Milne [19], which is valid for 
certain restricted classes ot points. 

For the single variable case, the purpose of the various interpolation schemes 
has been to put the interpolation polynomial in a form w'hich is more convenient for 
numerical computation. In the several variable case this is only accomplished to 
a much smaller degree. For the single variable case, the Vandermonde deter- 
minant plays a fundamental role in the derivation of the various interpolation 
schemes and in almost every case the simple single variable formulae can be 
derived from the general theorems on vector spaces by using the evaluation 
properties of this determinant. In the several variable case this tool is not 
available; for this reason the formulae will be considerably more complicated. 

For a more complete discussion of the topics discussed in this report we 
refer the reader to the list of papers in the bibliography. Almost all the ma- 
terial presented here can be found in one form or another in the work of Milne, 
Arntzen, Reynolds, Wheelock ([8]); Thacher ([16], [17], [IS]); Milne and Thacher 
([19]); Salzer ([11]); and Curry ([1]). 
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Preliminaries and Notations 


We shall assume the reader is familiar with the basic single variable in- 
terpolation techniques as found in Hildebrand [5] or Householder [7]. In addi- 
tion we assume the reader is familiar with the basic techniques of linear 
algebra as found in Hoffman and Kunze [22]. We shall briefly recall a few 
definitions and results from linear algebra and matrix theory which will be 
needed in the sections to follow. 

Let V and W be finite dimensional vector spaces. A linear operator T is a 
function 


T : V » W 


which satisfies the property 


ifcjU + Cjv) - Cl (r(u)) + c 2 (T(v)) . 

where Cj and c 2 are real numbers and u and v belong to V. When the range 
space W is the vector space of real numbers it is customary to use the term 
linear functional. One can easily show the collection of linear functionals de- 
fined in V is itself a vector space. This vector space is known as the dual 
space for V and is usually denoted by V*. The following results can be found 
in Hoffman and Kunze ([22], p. 90-96). 

Theorem (1.1): Let V be an n dimensional vector space. Then 

1) dim V = dim V* ; 

2) If Vj, . . . , v n is a basis for V, then, there exists a unique basis L lf 
L 2 , . . . , L n for V* which satisfies the property 

L . (v . ) = S. . . 

i \ j / » j 


This basis is known as the dual basis associated with v p . . . , v n . 

3) V = (V*)*. 
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We shall use the following notation: 

1) The symbol R will denote the real numbers; R" will denote the usual n 
dimensional Euclidean space. 

2) If Uj, . . . , u are members of a vector space V, then 

sp{u r • • • , u p } 

will denote the vector space spanned bv these elements. 

3) If a^] is an n x n matrix, the determinant of [a^] will be denoted by 

det [a i j] . 


Let A io , 0 be the matrix obtained from [a^l by removing the i 0 ,h row 
and j 0 ‘ h column. Then \ye shall use the notation 


Cof 



(‘ 1 ) 


0+, °detA 


o J o 


One particular matrix occurs quite often in interpolation theory. If x 0 , 
x j , . . . , x n are real numbers, we can consider the matrix 


1 

1 

1 


x 


n 





X 


n 

n 


The determinant of this matrix is known as the Vandermonde determinant. It 
can be evaluated by the following formula: 
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1 


X 


0 


det * 


1 


x 


n 




n <x i' x . > 

»> j 


([7], P. 91). 


1.2 GENERAL INTERPOLATION 

In interpolation theory we attempt to approximate a function f defined in a 
region G of R n by a finite linear combination 


<£(*) - a, (x) , 

j = o 


( 1 . 2 - 1 ) 


where {<?■ (x)j is a collection of linearly independent functions defined in G. In 
the most restricted form of interpolation we determine the constants {a.} by 
choosing a collection of base points x 0 , x J5 . . . , x m in G and requiring that 


40 " f ( x .) • 


( 1 . 2 - 2 ) 


for i = 0, 1, 2, ... ,m. Applying this condition to Equation (1.2-1) we obtain 
the m + 1 equations 


The condition 


f (*.) = Y'. a i ( x i) 

j = 0 


D - det <£. (x.)J f 0 


(1.2-3) 


(1.2-4) 
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is necessary and sufficient to guarantee that the system (1.2-3) has a unique 
solution. Therefore when (1.2-4) is satisfied, we obtain 


<U x) 


D j 

2^ ® *,<«>• 

j = o 


(!.2-5) 


where is the determinant of the matrix obtained by replacing the j th column 
of the matrix ( x i)J hy the column vector ( x ,)j . 

Alternately, some authors ([19], [7], p. 18G) define <£(x) by the formula 


A det 


o 

o 

• *n,( X o) 

f (*o) 

^0 ( X m) * 

’ ^( X m) 

f(*J 

A> <*> “ 

* <M X ) 



= 0 


( 1 . 2 - 6 ) 


If D / 0, formula (1.2-6) defines 0(x) uniquely as a linear combination of <£ 0 , 
<£ m . In order to show <£(x) defined in this way satisfies the condition 
imposed by Equation (1.2-2), we set x = x ( and expand (1.2-6) by minors of the 
last column; we obtain 


f ( X i) Cof ( f ( x ») ) + D ^( x j) " 0 (1.2-7) 

i 3 0 


However, since x - x f we have 


Cof 




if i / j 

if i = j 
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Therefore Equation (1.2-7) becomes 


-D*( Xj ) = -Df(*,) 

*(*,) = f (*>) ' 


We summarize the preceding discussion in the following theorem: 

Theorem (1.2.1): Let<£ 0 , <t> v . . . , 4> m be a collection of linearly independent 
functions defined in a region Gof R n and let x 0 , x p . . . , x m be m + 1 points in 
G. Suppose f is an arbitrary function defined in G. Then, there is a unique 
function <£(x) , which is a linear combination of (x)} and which satisfies the 
condition 


f ( x i) = *(*.) • 

if and only if 

D = det [$. (xj] f 0 . 


If this condition is satisfied, <£(x) is given by (1.2-5) or (1.2-6). 

Definition (1.2.2) : We refer to the interpolation problem considered in 
Theorem (1.2.1) as the restricted interpolation problem. The unique function 
<£(x) is known as the interpolating function for f at the points x Q , x, x m . 

We relate the preceding discussion to the problem of polynomial interpola- 
tion for functions of several real variables. 

Example (1.2.3) : Let f(x) be a real valued function defined in an interval 
[a, b] and let x Q , x p . . . , x m be m + 1 distinct points in [a, b] . For our basis 
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functions we take the collection 


t 0 (*) ~ 1 

<£,(x) = x 

= x n . 

In this case, the determinant in (1.2-4) takes the form 


D 





This determinant is the Vandermonde determinant and its value is given by 


D 




( 1 . 2 - 8 ) 


Since the points {xj} are distinct, this determinant is not zero and by Theorem 
(1.2.1) there is a polynomial 


m 



i * 0 
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such that 


p(xj ) = f (x .) i - 0, 1, 2, * * * , m . 


Example (1.2.4) : Let G be a region of R 2 containing the points 


x 0 = (-2,0), 



x 2 = (0,-2), 

*3 = (*• ~ j) 


Let f(x) be a function defined in G which takes the values 


f (( — 2» 0 ) ) = 4. 



f ((0, - 2)) = - 10 , 



For our basis functions we take the polynomials 

<*> 0 ( x> y ) = 1 • 

4> x (x, y) = x , 
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<£ 2 (x. y) 


- y . 

<£ 3 ( X, y ) = xy . 

In this case, Equation (1.2-4) becomes 



Since the above determinant is zero, the conditions of Theorem (1.2.1) are not 
satisfied and we cannot produce a unique polynomial in the form 

<£(x, y) = a Q + a,x + a 2 y + a 3 xy 
which satisfies the condition 

0(xi) = f (x A ) 


for i = 0, 1, 2, 3. 

Example (1.2.5) : In this example we consider the same base points and 
function f considered in Example (1.2.4). However, in this example we define 

<£ 0 (*• y ) = 1 • 

<t> x (x. y) = x , 

<t > 2 (*• y) = y • 

(p 3 (x, y) = X 2 . 
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In this case the determinant in Equation (1.2-4) becomes 


dot 



-2 

-3 

0 

1 


0 



-2 

.3 

2 



18 f 0 . 


Therefore, this time the conditions for Theorem (2.1.1) are satisfied. Using 
Equation (1.2-5) we obtain 

<£(x, y) = x 2 + 2x + 6y + 2 . 


Remark (1.2.6) : The above examples point out a fundamental difference be- 
tween single variable interpolation ant! interpolation for functions of several 
variables. In the single variable case we are always guaranteed a unique solu- 
tion to the restricted interpolation problem by choosing the functions 1, x, x 2 , . . . , 
x m for our basis functions. However, in the several variables case it may not be 
at all clear which monomials we must use in order to guarantee a unique solution. 
Except for certain special cases, the author is not familiar with any "short cut" 
techniques for determining whether or not a unique solution does exist. In most 
cases one must evaluate the determinant in Equation (1.2-4). 

There is, however, a geometric approach to this problem which might be 
valuable in some special cases. In Example (1.2.4) we can make the observations 
that the four base points lie in the algebraic curve 

p(x,y) = y + xy + x+ 2 = 0. 


This observation is in fact equivalent to the singularity of the matrix in (1.2-9). 
We relate the two ideas in the following theorem. 
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Theorem (1.2.7): Let <P 0 , 4- v . . . , be m + 1 linearly independent functions 
defined in a region G of R n and let x 0 , x r . . . , x m be m + 1 points in G. Then 

det [M x .)] = 0 


if and only if there exists a nontrivial algebraic curve in R" in the form 


P( x) 


m 



* = 0 


o 


such that p(x . J = o, for i = 0, 1, . . . , m. 

Proof: Suppose the points x Q , . . . , x m lie on the curve 


P(x) 


m 



i= 0 


o . 


where not all the coefficients (a^ are zero. Substituting the points x Q , . . . , x m 
in this equation we get the homogeneous system 


r 0 

i= 0 


(«,) = ° 

i= 0 


2 ^ ( X ">) ■ ° ' 
i= 0 


( 1 . 2 - 10 ) 
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Since not all the coefficients a f are zero, the above system has a nontrivial 
solution. It follows that 


det 



= 0 


Conversely, if the above determinant is zero the homogeneous system (1.2.10) 
must have at least one nontrivial solution a 0 , a p . . . , a m . The curve 


P(x) - a 4 </>. (x) - 0 

» = o 


satisfies the condition p(*j) = 0 for i = 0, 1, 2, . . . , m. 

■ 

1.3 INTERPOLATION ON TWO DIMENSIONAL GRIDS 

In most practical problems Theorem (1.2.5) is of little value. However, 
for the case of restricted polynomial interpolation we can apply Theorem (1.2.7) 
to rectangular and triangular grids of points in order to obtain a sufficient col- 
lection of monomials to guarantee a unique interpolation polynomial. 

We shall use the following lemma: 

Lemma (1.3.1) : Let p(x, y) be a polynomial in two variables and suppose 
for a fixed real number x Q the polynomial p(x Q , y) = 0 for all y. Then there 
exists a polynomial g(x, y)such that 

P(x, y) = (x - x Q ) g(x, y ) 


Proof: We can write p(x, y) in the form 


P(x. y) 


Pj (y)x‘ , 

i= 0 


(1.3-1) 


12 


where each coefficient p ; (y)is a polynomial iny. Since for each fixed y, the 
polynomial p(x 0 . y) is equal to zero, we can write 


n- 1 

p(x, y) = (x-x 0 ) J2 b, (y)x' . (1.3-2) 

i= 0 


We must show the coefficients b £ (y) are polynomials in y. However, compar- 
ing the coefficients of x 1 in Equations (1.3-1) and (1.3-2), we obtain 


b n-i(v) = p n (y) 


and 


b n-i (y) 


P n -i+ 1 (y) + x 0 b n-j + l 


for j = 2,3,...,n. Therefore, the coefficients b. (y) are polynomials in the 
variable y. 

■ 

We now turn our attention to rectangular grids in R 2 . Let ( x . , y . ) , 

( i = 0, - . . , n), ( j = 0,1,... , m) be (n + 1 ) (m + 1 ) points on a rectangular 
lattice in R 2 (see Figure (1.3.1)). 

Let F be a function defined in a region G of R 2 containing the above rec- 
tangular lattice. In the following theorem we obtain a collection of monomials 
which is sufficient to guarantee a unique solution to the restricted interpolation 
problem on the above grid. 

Theorem (1.3.2): Let f be a function defined in region G of R 2 containing 
the rectangular lattice in Figure (1.3.1). Then, there exists a unique interpolating 
polynomial 4>{ x . y ) in the form 


<£(x, y) 


i = n i = n 


* J 


x' y J 


(1.3-3) 
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Figure (1 .3.1 ) 

such that 

■*( x i' *>) = f ( x i • y i ) • 

for (i = 0, 1, . . . , n), (j = 0, 1, . . . , m). 

Proof: We prove this theorem by contradiction. Suppose a unique solution 
in the form of Equation (1.3-3) did not exist. Then, by Theorem (1.2.7), there 
exists a nondegenerate algebraic curve 


m , n 

p 0 y) = b ij xi i j = 0 
i . j 

such that 

PofXi.Vj) = 0 
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tor i = 0, 1, . . . , n and j = 0, 1, 2, . . . , m. Let x = x Q . The polynomial 
P 0 ( x o’ y ) has degree less than or equal to m in the variable y. Since it vanishes 
at the m + 1 points y 0 , y ,, . . . , y m { .c must vanish for all y. By Lemma (1.3.1), 
there exists a polynomial Pj (x, y) such that 


p 0 ( x - y) = ( x ■ x 0 ) Pi ( x > y) • 


We can apply the above process for the point Xj and the polynomial p t (x, y). 
Since Pj (x,, y ) is a polynomial in y of degree less than or equal to m which 
vanishes at y 0 , y 1§ . . . , y m , it must vanish for all y. Therefore, by Lemma 
(1.3.1), there exists a polynomial P 2 (x, y) such that 


p 0 ( x ’ y) 


( x ~ x 0 ) Pi( x - y) 


( x-x o) ( x_x i) p 2 < x - y) • 


Continuing in this manner, we obtain a polynomial p n (x, y) such that 


n~ 1 

p 0 ( x - y) = Y\_ ( x “ x i) p n- 1 C x » y ) - (1.3-4) 

i = 0 


Since p 0 (x, y) has degree less than or equal to n in the variable x, the poly- 
nomial p n _ j (x, y) can not depend on x. Therefore, we can write 


n~ 1 

p 0 ( x ' y) = (x-Xi) p„-, (y) • 

i = 0 


Now let x - x n . Since the polynomial p 0 (x n , y) has degree at most m in the 
variable y and since p 0 (x n , y) is zero for y = y 0 , y p . . . , y m , it follows that 
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Po ( x n ' y) = 0 for all y. Furthermore, since 


n- 1 

I ! r o 

i = 0 


and since P n (y)does not depend on x, it follows that p n (y) is identically equal 
to zero. But then p 0 (x. y) is identically equal to zero which contradicts our 
assumption that p 0 (x. y) be nondegenerate. 

The previous theorem does not guarantee a polynomial of lowest possible 
total degree. For example, consider the grid in Figure 1.3.2. If f is any function 


( x i / yq ) ( x i / Yi ) ( x l / Yz ) 



( x o • Yo ) ( x 0 / y i ) ( x o / y2 ) 


Figure (1.3.2) 

defined in a region G containing the above grid, then the previous theorem 
guarantees an interpolation polynomial of the form 

<£( x , y ) = a Q + a 1 x + a 2 x 2 + a 3 y + a 4 xy + a ( .x 2 y 
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such that <£(x, y) and f(x, y) agree at the points on the above grid. The poly- 
nomial <£(x, y) has total degree 3. There are, however, six monomials 1 , x, y, 
x 2 , xy, y 2 with total degree at most 2; unfortunately unique interpolation with 
these monomials is impossible. One can easily check that the points in Fig- 
ure (1.3.2) lie on the nondegenerate algebraic curve 

P(x, y) = (y- y 0 ) (y -yj = 0 . 


By Theorem (1.2.7), interpolation with the minimals 1, x,y , x 2 , xy, y 2 is 
impossible. 

The following theorem shows the above problem does not occur on triangular 
grids. By interpolating with the base points on a triangular grid we can obtain 
an interpolating polynomial of lowest possible degree. 

Theorem (1.3.3) : Let f be a function defined in a region G containing the 
triangular grid in Figure (1.3.3). Then, there exists a polynomial of total 
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degree n such that f and </> agree at the points of the above triangular 
lattice. 

Proof: We shall prove the theorem by contradiction: Suppose a unique 
polynomial <£(x. y) of total degree n did not exist. Then, by Theorem (1.2.7), 
there exists an algebraic curve p(x, y) of total degree n which vanishes at the 
points on the above triangular lattice. Let us write p(x. y) in the form 


P(x, y) 


n 



i= 0 


where (y) has degree n - i in the variable y. If we set y = y 0 , then 


p ( x - y 0 ) ' ^ A . (y 0 ) x ‘ 

i = 0 


is a polynomial in the variable x which vanishes at the n + 1 points x 0 , x lf . . . , 
x n . Therefore, since p(x, y Q ) has degree n, it follows that p(x, y 0 ) is zero for 
all values of x. In particular, the coefficient A r (y) which, as a polynomial in y, 
has degree zero must vanish at y = y 0 . It follows that A n (y ) is identically 
zero. Next we set y = y r In this case, the polynomial p(x, y j) will vanish 
at the n points x fl , x lt . . . , x n _ v Therefore, since p(x, y j) has degree n - 1 
in the variable x , it must be identically zero. Now we recall that A n _ j (y) has 
the form 


A n _ j (y) = cy + d . 


However, from the above remarks we have 


Vi(y») = 0 

A n-l(Vl) = <>• 
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which implies A n _ x is identically zero. In a similar way, one can show A n _ 2 (y), 
A n _ 3 (y), . . . , A 0 (y)are all identically zero. Therefore, p(x, y) is identically 
zero which contradicts the fact that p(x, y) be nondegenerate. 

The above techniques can be used to find monomials sufficient to guarantee 
a unique solution for points arbitrarily located at certain vertices of a rec- 
tangular grid. We illustrate the technique in the following example. 

Ex tmple (1.3.4) : Consider the problem of finding a sufficient set of monomials 
which will guarantee a unique interpolating polynomial for functions defined in a 
region containing the grid in Figure (1.3.4). 



Figure (1.3.4) 


We shall show that the monomials 


y 2 , y 2 x , 

y . yx , yx 2 , 

1 . X , X 2 


are sufficient to guarantee a unique solution to the problem. Suppose a solution 
did not exist. Then, by Theorem (1.2.7), there exists nondegenerate algebraic 
curve 


p( x i y ) = (a 2 + b 2 y)x 2 + (aj + bj y + Cj y 2 ) x 


+ (a 0 + b 0 y + c 0 ) (1.3-5) 
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which contains all the points on the above grid. Let y = y 0 . Then p(x, y 0 ) is a 
polynomial of degree 2 in the variable x which vanishes at the three points x 0 , 

Xj and x 2 . It follows that p(x, y 0 ) is identically zero for all values of x. In 
particular since a 2 + b 2 y is the coefficient of x 2 we have 


+ b v 
2 y o 


= 0 . 


(1.3-6) 


In a similar way we can set y - y, in Equation (1.3-5) to obtain 


+ b 2 yi 


= 0 


(1.3-7) 


Combining Equations (1.3-6) and (1.3-7) we obtain the homogeneous system 


a 2 + t, 2 y 0 = 0 

a 2 + b 2 y, = 0. 

Since y 0 r y 1 it follows that a 2 = 0 and b 2 = 0. We can use a similar tech- 
nique to show the constants a p bj and Cj are zero. In fact, if we let y = y 0 , 
yj and y 2 and look at the coefficients for x in c ich case we obtain the homogeneous 
system 


a i + y 0 b i + yo 2c i = 0 

a ! + y i b i + y i 2 c i = 0 

a ! + y 2 b i + y 2 2 C 1 " 0 (1.3-8) 
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Since 



(y,- y o) (y 2 ~ y i) {y* - y 0 ) 

/ o , 


the system (1.3-8) has the unique solution 


a j - 0 , 

b, = 0 , 

c i = 0 . 

In a similar way, one can show 



Therefore, ^*(x, y) is identically zero which contradicts the fact that p(x, y) = 0 
was a nondegenerate algebraic curve. Therefore, by Theorem (1.2.7) we can use 
the monomials y 2 , y 2 x, y , yx , yx 2 ,x , x 2 , and 1 to interpolate any function f 
defined in a region containing the grid in Figure (1.3.4). 
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In a similar way, it can be shown for the grid in Figure (1.3.5). 



Figure (1.3.5) 


A correct choice of monomials is 

y 2 , 
y . 

1 , 

Or possibly 

y 2 , y 2 x 2 , y 2 x 3 , 
yx , yx 3 , 

1 , x , x 3 . 

1.4 GENERALIZED LINEAR INDEPENDENCE 

In this section we briefly introduce the concept of generalized linear in- 
dependence. In particular, we introduce the concept of homogeneous and in- 
homogeneous degree n independence of points and show how this idea relates 



22 


to interpolation for functions of several variables. In Section 2.4, we use this 
notion to determine a sufficient set of conditions under which an Aitken type 
interpolation scheme is valid. For notational convenience we consider points 
in R m+1 . 


Definition (1.4.1) : A point x Q = (x 0 °, x 0 ‘ , . . . , x 0 m in R m+ 1 is said to be 
a homogeneous degree n combination of the points x lf . . . , x if there exists 
a collection of scalars (j = 1, 2, . . . ,p) such that 




(1.4-1) 


for all sets of nonnegative integers (rv : i - 0, 1, . . . , m} such that 


m 



i= 0 


Example (1.4.2) : If m = 2 and n = 2, then a point (x 0 , y 0 , z Q ) is a homo- 
geneous degree 2 combination of the point (x lt y p z x ) and (x 2 , y 2 , z 2 ) if and 
only if there exist constants a and b such that the following six equations are 
satisfied: 


x o 2 


aXj 2 + 

bx 2 2 

y 0 2 

= 

ay j 2 + 

by 2 2 

z ^ 

= 

az + 

bz 2 2 

x 0 yo 

- 

ax i yi 

+ bx 2 y 

o 

N 

O 

X 

= 

ax i z i 

+ bx 2 z 

y 0 z o 

= 

ayi Zj 

+ by 2 z 
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Definition (1.4.3) : A collection of points x p x 2 , . . . , x p in R m+ 1 is homo- 
geneously degree n dependent if and only if there exist a p a p . . . , a p , not all 
zero, such that 



for all sets of positive integers {n.; i = 0, . . . , m} such that 


Oi 



i= 0 


Definition (1.4.4) ; A collection of points x p . . . , x p is homogeneous 
degree n independent if it is not homogeneous degree n dependent. 

Homogeneous degree n dependence is a natural generalization of the familiar 
concept of linear dependence. Many of the linear concepts such as basis and 
dimension have natural extensions to the more general case. For a more com- 
plete discussion the reader should consult the original work of Thacher [16], 

Example (1.4.5) : For the case n = 1 Equation (1.4-1) becomes 


p 

x o‘ = 22 a * Xi ‘ ■ 

j= i 


for i = 0, 1, 2, . . . , m. It follows that x Q is a homogeneous degree 1 combina- 
tion of the points x p x 2 , . . . , x p if and only if x Q is a linear combination of 
x p x 2 , . . . x in the usual sense. 
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Example (1.4.6): Consider the points 


x o 

( , v m 

= (1.1) 


( x i- y 0 

■ (1.0) 

*2 

( x 2 ' y 2 ) 

(0, 1) 


In this case we show x Q is not a homogeneous degree 2 combination of Xj and 
x 2 . If x Q were a degree 2 combination of Xj and x 2 , there would exist constants 
"a" and "b" such that 


x Q 2 - axj 2 + bx 2 2 

x 0 y 0 = ax iyi + bx 2 y2 

y 0 2 = ayj 2 + by 2 2 • (1*4-2) 


Upon substitution, the second line of Equation (1.4-2) becomes 


1 = a(l)(0) + b(0) (1 ) = 0. 


Therefore, the point (1, 1) cannot be a degree 2 combination of (1, 0) and (0, 1). 

Many of the results for generalized linear dependence can be derived from 
known results in the linear case. We shall use the following well known lemma 
(see [6], [19]). 

Lemma (1.4.7) : There are (n + m)!/m! n! monomials in in + 1 independent 
variables of total degree equal to n. 

Proof: A monomial in the n + 1 variables x °, x . . . , x m with total de- 
gree n has the form 

ii (-r* . 

i« 0 
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where 


m 



i = 0 


(1.4-3) 


Therefore, the number of such monomials is given by the number of nonnegative, 
integer valued solutions of Equation (1.4-3). It is well known that the number of 
nonnegative, integer valued solutions of (1.4-3) is given by (n + m) !/n! m! (see 
[4],p. 36). 

■ 

Notation: We shall use the notation 


W n (m) 


(n + m) ! 
n i m ! 


Consider the mapping 


* , W„ ( m ) 

: R m+ 1 » R n 


defined by 


*n((*‘)) = (n ( X ‘n' 


i = 0 


where the collection {r^} ranges over all positive integer valued solutions of 
the equation 


m 



i= 0 
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Example (1.4.8): For n = 2 and m = 2 we have 


0 2 : R 3 * R 6 


defined by 


<t> 2 (x, y, z) - (x 2 , y 2 , z 2 , xy, yz, xz) . 


The following theorem relates homogeneous degree n independence in R m+ 1 
to linear independence in R n(m) . 


Theorem (1.4.9): Let x p . . . , x p be a collection of points in R m+ Then 
Xj, . . . , x p is homogeneous degree n independent if and only if the collection 
<£ n (*i)» • • . , <£„ (X p ) is linearly independent in R n (m) . 

_ _ W (m) 

Proof: Suppose x p . . . , 0 n x p is linearly independent in R n . Then, 
there are constants a i» • • • » a p , net all zero, such that 



= 0 . 


Looking at the components of each 4> n ( x . ) we have 



0 


for all nonnegative integer solutions (rr} of the equation 


m 



i = 0 
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It follows immediately from the definition that the points x p x 2 , . . . , x p are 
homogeneously degree n independent in R mM . The converse follows in the same 
way. 

In order to relate the above material to multivariate interpolation we need 
the following definition. 

Definition (1.4.10): A collection of points (x,) in R m is inhomogeneously 
degree n dependent (independent) if the collection 


x 

1 



• X 


r) 


is homogeneously degree n dependent (independent) in R m+ 1 . 

We can now present the main result of this section: 

Theorem (1.4.11) : Let f be a real valued function defined in a region G 
of R m and let (x. } be a collection of W n (m) points inG. Then there exists a 
polynomial of total degree n such that 


'*( x i) = f ( x .) 


for i = 1, 2, . . . , W n (m) , if and only if the collection is inhomogeneously de- 
gree n independent. 

Proof: Let {x i } be a collection of W n (m) inhomogeneously degree n in- 
dependent points in R m . By Theorem (1.4.9), the vectors {<£ n (x/)} are linearly 
independent in R Wf > (m) . Eut since the vectors {<£ n (x/ ) ] are the rows of the 
determinant in Equation (1.2-4) when the basis functions are taken as all 
monomials in m variables of total degree less than or equal to n, the existence 
of the polynomial <t> follows immediately from Theorem (1.2.1). The converse 
follows in a similar manner. 

■ 

Corollary (1.4.11) : A collection of W r (m) points {x.} in R m is inhomogeneously 
degree n independent if and only if there exists a nondegenerate algebraic curve 
<£(x) = 0 with total degree n, such that 

*(*i) = 0 


for i = 1, 2 W n (m). 
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For some further geometric results for degree n independence the reader 
should consult the paper by Whaples [20]. 


1.5 INTERPOLATION IN VECTOR SPACES 

Let 4> 0 , 4> l , . . . , 0> n be a collection of functions defined in a region G of R m 
and let V be the vector space of functions generated by this collection. If y is 
a point in R m , the evaluation function defined by 


%(*) = 4<y) 


(1.5-1) 


is a linear operator from the vector space V to the real numbers. In fact if 0 
and 0 are members of V and if c, and c 2 are real numbers we have 


E- (c,* + c,0) 


(c, 4 > + Cj 0) (y) 


= Cj 0(y) + C 2 0(y) 


" c i % (0) + c 2 E- (0) . 


It is not necessary to restrict our attention to linear functionals defined by 
Equation (1.5-1). In fact any collection c* m + 1 linearly independent func- 
tionals on V is sufficient to guarantee a unique solution to the interpolation 
problem. For example, if the functions {0^} and f are sufficiently smooth, we 
might consider a linear functional defined by 


L (0) 


am 

dx i <9x. 



or possibly one in the form 


L(0) 


1 


4> dx . 
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In fact the above methods can be generalized considerably. For arbitrary 
vector spaces Theorem (1.2.1) takes the following form: 

Theorem (1.3,1) : Let V be an m M dimensional vector spare with basis 
{v Q , v p . . . , v m } and let L 0 , L, , . . . , L ni be m + 1 linear functionals defined 
in V. The following conditions are equivalent: 

1) The collection {L ^ } is linearly independent. 

2) For all collections of real numbers r Q , r p . . . , r m , the condition 


Lj (v) 


r . 

j 


for j = 0, 1, . . . , m defines a unique vector in V. 

3) The determinant det [l^ (v.)] is not zero. 

Proof: (1) ~ =» (3). Suppose det [Lj (v j )] i 0. Then the homogeneous system 


= ° 
) = o 


7^ 3 j L j ( V m> " 0 

j-0 


has a nontrivial solution. Since 


j * o 

for i = 0, 1, . . . , m, it follows that 


£ a i L i< v) = ° 

j =0 
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for all v in V. However, this means the collection <L f } is linearly dependent 
which contradicts (i). Therefore det[Lj (v.)] = 0. 

(3) (2). A vector v in V has the form 


L 


a i v i 


Consider the system 


a i Lj ( v i ) = r, 

t ■ o 

a . L ( v . ) = r 

i m v i ' m 

i= 0 




(1.5 


Since 


det[L j (v 4 )] / 0 . 


the system (1.5-2) has a unique solution for the coeffic? mts a Q , a v . . . , a B . 
The unique vector 


v 


L 


V 


i 


3x 


satisfies the property 


M v > = r > 


for j = 0, 1, . . . , m. 

(2)=^ > (1). Suppose the collection (L.) is not linearly independent. Without 
loss of generality we assume 


L 


o 



(1.5-3) 


For a collection of real numbers r 0 , . . . , r m we have a unique vector v in V 
such that 


L; (v) 


Furthermore, by Equation (1.5-3) 


l ° (v) = 2 >,- 

j= i 

Choose a new set of constants s Q , . . . , s m such that 

s o ? r o 

and 


(1.5-4) 
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for 1 < j < m. Because of Equation (1.5-4) we cannot find a vector v such that 


Lj(v) = s, 

for 0 < j <m. Therefore, the collection {Lj}, is linearly independent. 



CHAPTER II 


INTERPOLATION FORMULAE FOR SEVERAL VARIABLES 


2.1 THE FUNDAMENTAL FORMULA 


Almost all interpolation formulas can be derived from the following ele- 
mentary theorem on finite dimensional vector spaces. 


Theorem (2.1.1): (Fundamental Theorem of Interpolation Theory) Let V 
be an n + 1 dimensional vector space with basis v 0 , v p , , , , v n and let L 0 , . . . , 
L n be a basis for the dual space V*. Then any v in V can be expressed in the 
form 



i ® 

> • 

O 

> 

c 

_) 

o 

> 

o 

L * 4 

det 

L 0 ( V n ) •'* L n ( V n) V n 


L o( V ) L n< V > 0 

det [L t (v,)] 


( 2 . 1 - 1 ) 


Proof: The expression on the right is a linear combination of v Q) . . . , v n 
and hence is a member of V. Let us denote this expression by v'. If we apply 
the linear functional Lj to v' we obtain 


Li (v*) 



L 0 ( v o) L n ( V o) 

L i ( v o)l 

det 

L 0 ( V n) ••• L „ K) 



L i K) 


> 

V-/ 

C 

/■V 

> 

o 

0 

det [Lj (Vj) 
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In the determinant in the numerator we subtract the i th column from the last 
column and obtain 


det 


MO = ~ 


tr 

© 

o 

•' L n ( V o) 

c 

> 

o 

" L n( V J 

L o ( v > * 

/^S 

> 

C 


de, [ L i ( v i)] 

Expanding the numerator by the last column we obtain 


0 

0 

(v) 


-(-L,(v))det[l 

■i (v,)] 

det 

L ( v . ^ 
1 V u 

i] 


" L. ( v ) , 

for i = 0, 1, 2, . . . , n. By Theorem (1. 5.1-2) we have 


v 


By interchanging the roles of V and V* we obtain 

Theorem (2,1.2) : Let V* be the dual space of an n + 1 dimensional vector 
space V. Let L 0 , . . . , L n be a basis in V* and v Q , . . . , v n be a basis in V. 
Then any L in V * can be written 


L 0 ( y o) "• L 0 ( v n) L o 

• • • 

• • • 

L f v A \ • • • L (v ) L 

n \ 0 1 n \ n / n 
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In the determinant in the numerator we subtract the i th column from the last 
column and obtain 


Mv') = - 


i-o K) l .K) 


L 0 W L n( V J 0 

L„(v> ••• L„(v) -Li(v) 


[ L i ( v i)] 


Expanding the numerator by the last column we obtain 


Mv') = 


- (- Lj (v)) det [Lj ( Vj )] 


[ L * ( v i)] 


" M v ) • 


for i = 0, 1, 2, . . . , n. By Theorem (1. 5.1-2) we have 


v - v . 


By interchanging the roles of V and V* we obtain 

Theorem (2.1.2) : Let V* be the dual space of an n + 1 dimensional vector 
space V. Let L 0 , . . . , L n be a basis in V* and v Q , . . . , v n be a basis in V. 
Then any L in V* can be written 


, L o ( v o) ••• L o K) L o 


L n ( v o) L „ ( v n) L „ 

L W ••• L ( v „) °_ 

det [ L i ( V i)] 
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In other words, the Lagrange coefficients l { (x) are the unique dual basis in 
V** = V associated with the basis E 0 , E p . . . , E n in V*. It is actually possible 
to obtain a formula for a general vector space which is similar to Equation 
(2.2-1). If we expand the determinant in the numerators of Equation (2.1-2) by 
the bottom row and then rearrange the columns we obtain 


n 

7% (v)0 i 


(2.2-3) 


where 



r ' 

O 

< 

o 

L i-1 ( v o) v 0 L i.l ( v o) •• 

^ o 
> 

c 

det 

• 

. 

• 


_M V „) •' 

" L .-l ( V n) V „ L ,*l ( V n) • 

' ' L n ( V „) 

det [ L i ( v i)] 


0 : = 


Formula (2.2-3) is known as the generalized Lagrange interpolation formula and 
the are the generalized Lagrange interpolation coefficients. One can easily 
check that 


M*j) = 8 u- 


For polynomial interpolation in several variables the Lagrange formula 
takes the following form: 

Theorem (2.2.1) : Let f be a function defined in a region G of R n and let x 0 , 
Xj , . . . , Xm be m+ 1 points in G. Let <£ 0 (x), 4> l (x)» . . . , 4> m (x) be m + 1 
monomials in n variables such that 


det [M x i)] ^ 0 
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Then, the unique interpolation polynomial is given by 


m 

p (x) = ^ f (*j) (*) • 


(2.2-5) 


i = o 


where 


^j(x) - 



~M x 0 ) 

o 

"x? 

•e- 

o 

XI 

s-/ 

Mv.) •"*<> ( x J 

det 

• 

• 

• 


(*o) 

•" MVl) *n<*> 


det [*i( x i)] 


Proof; The proof is an application of Theorem (1.5.1) and the preceding 
discussion. 

■ 

In the case of single variable interpolation, we can use the properties of 
Vandermonde determinants to reduce the Lagrange coefficients to the form found 
in Equation (2.2-1). Except for special cases, such a reduction for the several 
variables case is not possible. 

Lagrange Interpolation on a Two Dimensional Grid 


One case, where a simplification of the Lagrange coefficients is possible, 
occurs when the points are located on a rectangular grid as shown in Figure 
( 2 . 2 . 1 ). 


Let f be a function defined in a region G containing the above grid. By 
Theorem (1.3.2), we can obtain a unique solution to the interpolation problem 
by using the monomials 


1 , 

x . • • • , 

, X n 


y . 

yx , • • • , 

, yx n 

(2.2-7) 

y m . 

y m x , , 

, y m x n . 
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Then, the unique interpolation polynomial is given by 


where 


•C, (x) 


det 


p ( x ) = ^ f ( x i) ^ j ’ (2.2-5) 

j = 0 


o 

* • 

o 

Mvi) 

■M x > M x i*i) ' 

' *0 K)~ 

K K) 

••• MvO 

< X > ( X j*l) • 

" M 5 »t 


det [^i( x i)] 


Proof: The proof is an application of Theorem (1.5.1) and the preceding 
discussion. 

■ 

In the case of single variable interpolation, we can use the properties of 
Vandermonde determinants to reduce the Lagrange coefficients to the form found 
in Equation (2.2-1). Except for special cases, such a reduction for the several 
variables case is not possible. 

Lagrange Interpolation on a Two Dimensional Grid 


One case, where a simplification of the Lagrange coefficients is possible, 
occurs when the points are located on a rectangular grid as shown in Figure 
( 2 . 2 . 1 ). 

Let f be a function defined in a region G containing the above grid. By 
Theorem (1.3.2), we can obtain a unique solution to the interpolation problem 
by using the monomials 


1 . 

x . • • • , 

, x n 


y . 

yx , • • • , 

, yx n 

(2.2-7) 

y m . 

y m x , • • • , 

, y m x n . 
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The polynomial p(x, y) is a linear combination of the monomials in (2.2-7) and 
it satisfies the property 


p( x i • y ,) = f K' y,) • 

Furthermore, the coefficients i t ( x ) -£ . (y) satisfy the fundamental property 

(y ( ) r 1 

i i KHj (y^) = 0 k / i , -e / j . 

Alternately, we may derive Equation (2.2-8) fiom Equation (2.2-6). Although 
this approach is more complicated we include it to illustrate the techniques 
needed to derive results from the general formula (2.2-6). We shall use the 
following lemma. 

Lemma (2.2.3) : Let (x. , y j ) (i = 0, 1, . . . , n), ( j = 0, 1, .... m) be the 
(m + 1 ) (n + 1) points on the grid in Figure (2.2.1). Then for each fixed set of 
indices (i 1 , j 1 ) we have 



= n(v~ x ‘) n ( y i i- y i) c ° f ( x i " y j ') ■ 

i = 0 j = 0 

i^i 1 j^jl 
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Proof: Consider the matrix 


v 2 ••• v^v** 1 

A n A n j n 


x 2 ... x n v m 

A i A i y n 


(2.2-9) 


1 X V x 2 ... x n y m 

n J m n n J m 


Replace the pair (x.# t y .# ) in P by the variable points (x, y) and let P(x, y) de- 
note the polynomial obtained by taking det[P] with this substitution. Let x = x Q . 
It follows that P(x Q , y) is a polynomial of degree m in the variable y which 
vanishes at the m + 1 points y 0 , y Jt . . • , y m and therefore for all y. Therefore, 
by Lemma (1.3.1), there exists a polynomial O 0 'x, y) such that 


P(x, y) = (x- x Q ) Q 0 (x, y) 


Repeating the above procedure for each i / i 1 and each j / j 1 we obtain 


P(x, y) - 


n ( x ' x ‘) n i y_y i) ° x ' y 


To determine C(x, y ) we note that 


n ( x - x o n ( y - y -) 


contains a term x n y m and therefore C(x, y) must be the coefficient of x" y m in 
P(x, y). Expanding the determinant of the matrix which defines P(x, y) by the 
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last column we see that 


C(x, y) = C°f ( x . n # y."»j • 

Therefore 


p<». y) = J3 ( x_ x i) IT (y-Vi) c °f (*;,*;,) • 

i-'i' )*1 


Letting x = and y = y we obtain the result of the lemma. 

T heorem (2.2.4) : The Lagrange coefficients for interpolation on a two di- 
mensional grid are given by 


i 


(x, y) 



i) IT ( y - y i) 

i'? 

o n, ( y ,* y i) 

i*i 


Proof: Evaluating the determinants for the Lagrange coefficients in Equa- 
tion (2.2-6) by the previous lemma we have 


t ., ( x - y) 


1 ! ( x_x i) IT (y -yj) Cof ( x "y”) 

i'? 





~ y j) c°f ( x "t y .i) 
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However, since 


Cof(x n y m ) = Cof^x^y™^ f 0, 


we obtain the result. 


2.3 DIVIDED DIFFERENCES FOR SEVERAL VARIABLES 

In this section we present a generalization to functions of several variables 
of Newton's fundamental interpolation formula in terms of divided differences. 

The early definitions for divided differences of functions of several variables 
(see [8]) where based on an iteration of the difference operations for each 
variable taken separately. Bv there very nature, these processes place the 
base points at the corners of an n-dimensional rectangular grid. A different 
definition is given by Whittaker and Robinson [21] where the points are located 
on a two dimensional triangular grid. Salzer (see [10]) presents two more gen- 
eral schemes, however neither scheme gives a polynomial of lowest possible 
degree and in both cases we obtain polynomials with more coefficients than base 
points. 

The generalization of divided differences that we present was first explicitly 
given by Salzer [11], however a more general scheme which can easily be applied 
to the several variable case had been given earlier by Curry [1] and more recently 
by Davis [3], We present a variation of Curry's method and apply it to polynomial 
interpolation in several variables to obtain some of Salzer's results. The gen- 
eralization presented here is applicable to arbitrarily located points as long as 
the determinants appearing in the denominators are not zero. 

To motivate the several dimensional approach we briefly list some of the 
main properties of divided differences and Newton's ^fundamental formula. 

Let f be a function defined on an interval [a, b] which contains the points 
x Q , x x n . Since the polynomials 

v o = 1 

V, = (x-x 0 ) 

V n = n (X ‘ Xi) 

i * 0 
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are linearly independent, they form a basis for the vector space V spanned by 
the monomials 1, x, x 2 ,...,x n . Let E 4 (</>) be the evaluation functional on V 
defined by 


Ei(<£) = tf(x 4 ) 


Since 


det [ E i( v ,)] " det 


1 1 1 

0 ( X l' X o) •“ ( X n" X o) 
0 0 

n- 1 


n (».-«,) 


i= 0 


/ 0 , 

it follows from Theorem (1.5.1) that there exists a polynomial 


p ( x ) " ^ atj Vj (x) (2.3-1) 

i = o 


such that 



f (*i) 


for i = 0, 1, 2, . . . , n. In Equation (2.3-1) the coefficients a. are called the 
divided differences of order j and are usually denoted by [0, 1, . . . , j], [x 0 , . . . , 
x .] or [f (x 0 ), . . . , f(x j ) ]. The polynomials {IT (x)} are known as the Newton 
Polynomials. 
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Three important properties of these differences are summarized in the 
following theorem. 

Theorem (2.3.1) : 

1) The divided difference [0, 1, .... j] can be considered as a linear 
functional on 


V = sp{l, x, x 2 , • • • . x n } 


which is a linear combination of the evaluation functionals E,, E 2 , . . . , E } . 
It is given explicitly by 






2 ) 


[0, 1, ••• , j] (<£) 


1 


det 


The divided difference [0, 1, 2, . 

[0, 1, • • * , j] (x k ) 


x j • • • Xj 1 ' 1 E j (<£) 



. . , j] satisfies the following: 

= 0 k < j 

= 1 k = j . 


3) The divided difference can be computed by the following recursion 
formula 


[0. 1. , j] = 


_ [1, 2, * * * , j] - [0, 1, • • • . j - 1] 


x i 


Proof: Statement (1) is proved in Householder ([7], p. 203) and is also a 
special case of Theorem (2.3.3). Statement (2) follows directly from statement 
(1). Statement (3) is discussed in almost any book on numerical analysis. ^ 
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In a similar way the Newtoa polynomials possess a number of important 
properties. 


Theorem (2.3.2) : 
l)Ej(V k ) = 0 


j < k . 


2) V } is a linear combination ofl,x,x 2 ,...,x j 


] * 

3 >m v .) * n (-.-■) 


• x. j_1 
i- 1 


Proof: All three properties follow directly from the definition anc the 
properties of Vandermonde determinants. ^ 

With this motivation we have the following general theorem in finite di- 
mensional vector spaces. 

Theorem (2.3.3) : Let V be a finite dimensional vector space with basis V 0 , 

Vj V n . Let L 0 , Lj, . . . , L n be a collection of linear functionals on V such 

that the subcollection L^Lj , . . . , L k is linearly independent when considered 
as linear functionals over 


v- = sp{v„, V,. ••• ,V„} 


Then, there exists a unnue basis N 0 , N p . . . , N n for V* satisfying the properties 

a-1) N k is a linear combination of L 0 , . . . , L k 
a-2) N k (V = 0 for j < k 

a-3) N k (V.) - 1. 
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Similarly, there exists a unique basis W 0 , . . . , W n of V which satisfies the fol- 
lowing properties 


b-1) W k is a linear combination of L 0 , . . . , L k 
b— 2) Lj (W k ) =0 for all j < k 


b-3) L k (W k ) 



O 

o 

' • K (V 0 ) 


det 

• 

• 



i-0 (V k ) • 

• ■ L u (V k )_ 



I-o(Vo)--- L k -,(Vo) 


det 




(2.3-2) 


The functionals N k are known as the generalized divided differences for V and 
the vectors W k in the generalized Newton Polynomials. 

Proof: We shall just determine the generalized divided differences N k . Con- 
sider the subspace 


V k = sp{v 0 , V,. ••• ,v k } 


By our hypothesis, the functional L Q , . . . , L k are linearly independent when con- 
sidered as functionals over V k . By Theorem (2.1.2), there exists a unique vector 
N k in V k * satisfying the property 

N k (V.) r 0 for j < k 
N u (V k ) = 1. 
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In fact N k is given by 



o 

o 

Lo (V k ) 

L 0 

det 

Lk (V„) • • • 

K (v k ) 

K 



0 

0 1 

o_ 


o 

o 

— L 0 (V k ) 


det 

• 

• 



_Lk (v 0 ) 

L k (V,.) 



Expanding the numerator of N k by the bottom row we obtain 

f L 0 ( v o) • • • Lp (V.) L 0 1 


det 


N 


k 


K (v 0 ) • • • l„ (v k - ,) L k 


det 


L„ (V„) 

L L k ( v °) 


l oK) 
L k (v k ) 


(2.3-3) 


To obtain the Newton polynomials we apply the exact same process. Since the 
functionals L 0 , . . . , L k are a basis for (V k )* we can apply Theorem (2.1.1) to 
obtain the existence of a vector W k in V such that conditions (b-2) and (b-3) are 
satisfied. In fact 


L o( v o) ••• L „ K) v o 

L. K) • • • L„ (V k ) V„ 

. 0 0 0 L k("k) o_ 

L o ( v c) Lk (V 0 ) 
let ! ! 

L c (V k ) ••• L k (V k ) 
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Expanding the numerator by the bottom row we obtain 


*„ = L k (W k ) 


Using Equation (2.3-2) we obtain 

i.W - L k .,W v o 


det 


W, 


L .W-v,W v , 


det 


>-o(v„) ••• L k -,( v o) 

^0 (^k- l) ' ' ' ^k- 1 ( V k-l) 



L o ( v o) ’ ’ ' ^k- i (V 0 ) 

V 0 

det 


• 

• 


L 0 (V„) ••• L k .,(V k ) 




L 0 (V„) •" Lk(V 0 ) 



det 

L 0 (V k ) •" L k (V k ) 



(2.3-4) 


Conditions fa-1), (a-2), (a-3) and (b-1), (b-2) and (b-3) follow from the expres- 
sions for N k and W k . 

In order to show {N k ) and (W k ) are bases for V* and V we must show they 
are linearly independent. Suppose the collection (N k ) is not linearly independent. 
Then there exist constants { a . } not all zero such that 


£ a i N > = 0 

. = f\ 


Let i 0 be the maximum index such that a i / 0 . Then, if c . 
write 



i= 0 



, we can 
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But this implies N ifl is a linear combination of L p L 2 , . . . , L i() - i. However, 
using Equation (2.3-3) this will imply L: is a linear combination of L p L 0 , . . . , 

L i Q _ j which is impossible. Therefore {N k > is linearly independent. In a similar 
way we can show {W. } is linearly independent. 

■ 

In the next theorem we show {N. } is the unique dual basis associated with 

<»„>• 

Theorem (2.3.4) : The divided differences {N k ) and the Newton polynomials 
{W k } satisfy the following relationship: 


M*.) = s ik - 


Proof: Let Wj q be a fixed Newton polynimial. We divide the proof into 
three cases: 

1) Case I. (k > j 0 ). By Theorem (2.3.3) we have 

M v i) = 0 


for j <k. Since W j() is a linear combination of V p V 2 , . . . , V j() and 
since j 0 <k we have 


N 


k 



= 0 . 


2) Case n. (k - j n ) . Using properties (a-2) and (a-3) in Theorem (2.3.3), 
formula (2.3-4) gives 


N . 


o 



det 


" L o (V.) 
L o K) 


det 


" L o l v o) 

Lo (V k -,) 


L k -,(V 0 ) 0 

L k -,(V k ) 1 

•• L k - , (V 0 f 

' • L k - , (V k . ,) 


= 1 . 
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3) Case III. (k * j 0 ). By Theorem (2.3.3) we can write N k in the form 


k 


i = 0 


Therefore, using formula (2.3-4) we obtain 


det 


n ‘K) = 


k 

Lo(V„) ••• L i 0 -.( V o) 2I C ‘ L *W 

i = 0 


k 

L o ( V io) ■ L *o-‘ ( V io) Z>.(\) 


i= 0 


det 


i= 0 


det 


I-o(V„) ••• L )o .,(V # ) 

_ L -(V«) - L >o-*( V io-*)_ 

~ L o( v o) ••• L i 0 -.( V o) L i( V o) 

>( V i 0 ) V>( V J M^)] 


det 


l »K) ••• V.K) 


MV-) L i 0 ‘ l (\-i) 


For each determinant in the numerator above we have two columns alike; 
therefore 


N - ( W io) = 
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We are now able to obtain the generalized Newton representation formula 
for both vectors in V and functionals in V*. 

Theorem (2.3.5) ; Let V, {VT} and {L 4 } satisfy the same properties as in 
Theorem {2.3.3). Then for all u in V we have 


u = 5 N k <u)W k . (2.3-5) 

i = 0 


For all L in V* we have 


l = 2Z loo n „ • 

k= 0 


(2.3-6) 


Proof: We prove (2.3-5). Formula (2.3-6) is proved in the same way. By 
Theorems (2.1.1) and (2.3.3) we have 



0 

1 ••• 0 

w o 


0 

1 • • • 0 

W 1 

det 

• 

• 

• 


0 

1 

w n 


N 0 ( u > 

••• N n (u) 

0 


1 

o 


det 

0 1 ••• 0 



• o 



Evaluating the determinant we have the result. 


52 


Before we derive a recursion formula analogous to part (3) of Theorem (2.3.1), 
we make a number of observations. From Equation (2.3-4) we observe that W k 
depends on the vector space basis V # , , , . , V k and the functionals L 0 ,...,L k 
and it is invariant under any permutation of these functionals. In the proof below 



‘k- 1 


) 


to indicate the Newton polynomial depends on the basis V 0 , V p . . . , V k and the 
linear functionals L ai , . . . , L ak . Similarly, from Equation (2.3-3) we can see 
N k depends on the basis vectors V 0 , V t , . . . , V k and the functionals L 0 , L 1P . . . , 
L k . We shall use the notation 



) 


to indicate dependence on V QI V lt . . . , V k and L a() , . . . , L ak . 

We can now prove the promised recursion formula. Throughout this dis- 
cussion we have an ordered basis {V k ) for V which shall remain fixed. Assume 
k > 2. We shall derive a formula for N k (0, 1, . . . , k) in terms of N k _ k (0, 1, . . . , 
k - 1 ) and N k _ k (1 k). Let 

L k , L 2 , * , L k _ k « L 0 , L k , L k+ j , L n 


and 


L, , L 


1 ’ ^ 2 ’ 


L k-1 


L k’ L 0’ L k+ 1 ’ 


L 


n 


be two orderings of the linear functionals {L k } and let u belong to V. Using 
Theorem (2.3.5) and the first ordering we can write 

u = N 0 (1)V 0 + 11,(1, 2) Wj ( 1 ) + ••• 

+ N k _ 2 (l, , k-l)W k . 2 (l, ••• . k-2) 

+ N k _ k (1, ••• , k- 1, 0)W k . 1 (1. ••• . k - 1) 

+ N k (1, ••• , k- 1, 0, k) W k (l, ••• . k- 1, 0) 

+ ••• + N n (0, 1, 2, ••• . n)W n (0, ••• , n - 1) . (2.3-7) 
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Using the second ordering for the linear functionals we obtain 


u = N 0 (1)V 0 + Nj (1. 2) Wj ( 1) + 


+ N k - a (l. *■ 

• . k-l)W k _ a (l, 

••• , k- 2) 

+ N kM (I. •• 

* . k)W kM (1, ••• 

, k- 1) 

+ N k (l. •** 

, k, 0)W k (I,-*-, 

k) 


+ •“ + N n (0, 1, , n)W n (0, , n-1) . (2.3-3) 

Setting (2.3-7) equal to (2.3-8) we obtain 
Njc-j (1. — . k - 1, 0)W kM (l. • k- 1) 

+ N k (1, *• * , k - 1, 0, k) W k (1, ••• , k- 1, 0) 

= N k _ j ( 1 . . k) W kM (l, , k- 1) 

+ N k (1. ••• . k, 0)W k (1, ••• , k) . 


Rearranging we have 

(N k .,(l, ••• ,k-l,0) - N k .,(l. . k))W kM (l, .k-1) 

= - N k (1, ••• . k - 1, 0, k)W k (!, ••• . k - 1. 0) 

+ N k (1, ••• , k. 0)W k (1. , k) . 

By the previous remarks, this equation is equivalent to 
(N kM (0. , k-1) - N kM (l, , k) W k _ j ( 1 . •“ ,k-l) 

= - N k (0, • * • , k) -W k (0, ••• , k- 1 + W k (1. . k)) . 
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Applying L k to both sides and observing that 


L„(w k (l. ••• ,k)) = 0. 


we have 

(N kM (0, ••• , k- 1) - N k _, (1. ••• . k))L k (Vjd- * k ~ 1 )) 

= “ N k (0, ••• , k)L k (0, • •• , k- 1) . 


Therefore, if L k (W k (0, . . . , k - 1 )) / 0 , we have 


N k (0. ••• , k) 


c [ N k- i C 1 . •** • k)-N k _ i (0- *'• • k- 1)] (2.3-9) 


where 


L„ ••• . k-D) 

L k (W k (0, ••• . k- 1)) ' 


(2.3-10) 


We summarize the above remarks in the following theorem: 

Theorem (2.3.6) : Let V, (L^ and (V.) satisfy the conditions of Theorem 
(2.3.2). Furthermore assume k > 2 ana 

L k (W k (0, ••• , k- 1)) / 0 . 


Then, the recursion formula is given by (2.3-9) and (2.3-10). 

We can now state the divided difference formula for functions of several 
variables. 


Theorem (2.3.7) : Let f be a function defined in a region G of <? n . Let 
4> 0 (*). . . . ,<£ n * i (*) n h 2 ^nearly independent functions defined in G and let 
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and 


det 


E(x) - [0, 1, 2, • • • , x] 


M X o) "• *o( X a) *1 


A.*l ( X o) ••• 1 ( X n ) A ..1 


det 


^0 ( X o) *" ^0 ( x n) 
( X o) M X n) 


Proof: Let x 0 , . . . , x n belong to G and let x be an arbitrary point in G. The 
result follows from Theorem (2.3.3) by defining L i (#) to be the evaluation 
functionals 


L 4 ( 4 > ) - . 

i = 0, 1, 2, . . . , n and (<£) the functional 

Lit = ^( x ) ■ 


As in the single variable case we can compute the divided differences ac- 
cording to the following scheme 



For computational purposes it is also helpful to keep track of the various de- 
terminants in formula (2.3-10) for the constant C. 
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Theorem (2.3.7) shows that Newton's divided difference formula for func- 
tions of several variables is considerably more complicated than the correspond- 
ing formula for the single variable case. However there are certain special cases 
where the formula can be considerably reduced. For divided differences on a 
triangular grid the reader should consult [21] p. 372. For divided differences on 
a rectangular grid see [19] p. 31. 


2.4 AITKEN INTERPOLATION 

In interpolation for a single variable we can solve for the interpolation 
formula according to the following scheme. If Pj { ( x ) is the unique 

polynomial such that 1 p 



f K) 


for j = 1, . . . , p, then 



1 

: (x) - det 

p ‘,- 


X - X . 

*p-l 


. . , 1 v ' X . X . 

P 11, 

p p -l 

JV 


x_x i , 

p- 1 



We can compute P 0 t n (x) by the following scheme 
P, 


P P 
r 1 0,1 


P P P 

2 r 0 ,2 r 0 . 1 . 2 . 


0 , n 


0 , n- 1 , n . 


0,1,2 n 


It can be shown that the Aitken formula can be derived directly from the 
Lagrange formula using the properties of Vandermonde determinants. For this 
reason it does not appear that . scheme similar to Aitken's scheme should be 
valid for the several variab . case. However, there is an Aitken type scheme, 
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for functions of several variables, which is due to Thacher and Milne [19], 
which is valid for a restricted class of points. In this generalization, we add 
enough points at each step to obtain the polynomial of next highest total degree. 
The scheme is valid in R n , however for simplicity we consider all the points 
in R 2 . 

A sufficient set of conditions to guarantee a generalized Aitken mtthod is 
the following. 

Definition (2.4.1) : A set S in R 2 is called an acceptable set if the following 
are satisfied 

1) S n has (2 +n)!/2! n! inhomogeneously degree n independent points 

2) S n can be factored into the subsets Sj n_1 , S 2 n ~ 1 and S 3 n-1 such that 

a) S n = S^ -1 US 2 n-1 U S 3 n “ 1 

h) S n - 0 S"* 1 = {x.} for 

j=i 1 
j*k 

k = 1, 2, 3 . 

c) The set B = {x k ) k= j 2 3 defined by (b) is inhomogeneously degree 1 
independent 

d) If x belongs to S n but not to S k n " 1 then x is an inhomogeneous degree 1 
combination of B - (x k ). 

Each set S k n " 1 is an acceptable set by the above definition. 

Aitken 's generalization takes the following form: 

Theorem (2,4.2) : Let S n be a set of (2 + n)!/2! n! points satisfying the 
above conditions and let f be a function defined in a region G of R 2 containing 
the set S n . Then, there exists a unique polynomial P n of total degree n such that 

P n( X i’yi) = f ( x i- Vi) 
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for all (x A , y 4 ) in S n . In this case 


det 


P n( x - V) = 


p n-i(*’y) 

P n-1 ( X - y) 
P n-1 ( X - y) 


det 


( X 1 •*) 
(Xj-x) 

(x 3 -x) 


(y,-y) 

(y 2 -y) 

(y 3 -y) 


(2.4-1) 


where the set 

B = {( x i' *i)' ( x 2 * y 2 )’ (v y 3 )} 

is defined by condition (c) in Definition (2.4.1) and 

i’o-i ( x i- Vi) = f ( x i-yi) 

for all (x it y.) in S k n_ 1 (k = 1, 2, 3). 

Proof: The existence of P n (x, y) follows immediately from Theorem 
(1.4.11). We must show formula (2.4-1) is valid. We remark that the determinant 
in the denominator is not zero since the points in B are inhomogeneously de- 
grees 1 independent. Proceeding inductively, we notice since each P n k (x, y) 
has total degree n - 1 , the polynomial P n (x, y) has total degree at most n. it 
remains to show 


p n ( X i • y t ) = f ( x i- yi) 


for all (x £ , y A ) in S n . We divide the proof into two cases. 
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Case I. ((x it yj belongs to B). Without loss of generality we choose w.ie 
point (x, t y,). Expanding (2.4-1) we obtain 


P „‘-i ( x i- y,)det 


P n (*!• Vj) 


x 2 -x, y,-y, 


X 3‘ X 1 Va'Vi 


1 Xj y, 


det | 1 x 2 y 2 


L 1 x 3 » 


Since (x p yj) belongs to S"" 1 , we have 


P n‘-l( X l’yi) = f ( X l- Vl) 


Therefore, since the determinants in Equation (2.4-2) have the same value we 
have 


p n( x i'yi) - 


Case II. In this case we assume (x it yj belongs to S n but is not one of the 
points (x lf yj), (x 2 , y 2 ) and (x 3 , y 3 ). By condition (2-b) in Definition (2.4.1) 

(x if y j) must belong to at least two of the sets S k n " l . Without loss of generality 
we assume (x it y . ) belongs to S" - 1 and S 2 n ~ 1 but not to S 3 n ~ l . Then 


P n( X i'yi) - 


■ f( x i-yO 

det f(x iiyi ) 
p „ 3 -, (*l- Vi) 


( x . “ x i) 
( X 2 ~ X i) 
( X 3 ” x i) 

x i y i" 

x 2 y a 

x 3 y 3 


( y 2-y i ) 

(y 3 -yi) 
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The determinant in the numerator can be rewritten by subtracting the first row 
from rows two and three; we obtain 


det 

f ( x i ■ yO ( x i _x i) (yi‘Vi) 

0 ( x 2 — x i) (vi _ y 0 

p „-i ( x i- yi) _f ( x r Vi) ( x 3 _x i) (y 3 ‘yi)_ 





1 x, y, 


det 

1 x 2 y 2 



i X 3 *3 



Expanding the numerator we have 


det 


P n Vi) = f i • y i ) 


det 


*1 

y 2 

y 3 


J 1 
y 2 
y 3 


det 


+ p n-l ( x i- y*) 


x i _x i yj-yi 

y 2 “yi 


x 2 _x i 


det 


yi 

y 2 

y 3 
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hh 


However, since 


det 



y 1 - y f 

y 2 -yi 


det 


Vi 


1 X, y, 


and since (x., y i ), (x p y x ) and (x 2 , y 2 ) are inhomogeneous degree 1 dependent 
(condition (2-d)), we have 



Therefore 


P n( x i-Vi) - f ( x i’ y i)‘ 

Suppose (x., yj) belongs to S^ -1 , S 2 n_1 and S 3 n “ l . Then Equation (2.4-1) gives 



— — 



1 x i _x i yi" y i 





f(x,, y,) det 



i x a _x i y 2 " y i 



i X 3 - Xi y 3 -y L 





1 x . y . 



i 'i 


det 

i X, y j 




1 * s 







= f (**• y.) 
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It is difficult to prove whether or not a given set is acceptable. However, 
we can prove a triangular grid is acceptable set. 

Theorem (2.4.3) : The triangular grid in Figure (2.4.1) is an acceptable 

set. 



Figur* (2.4.1) 


Proof: We prove the theorem by induction. First let n = 1. We must show 
the set 


is acceptable. Since 


det 


Li X 1 


y<> 

y 0 


= ~ ( x i " x o) (y x -y 0 ) 


r o , 


( 2 . 4 - 3 ) 


and since S 1 has 


(2 + 1 )! 
2! 1! 


points, it follows that condition (1) is satisfied. If we let 

s i° = {(*<>• *«)} 

s ° = {(*<>• -■>)} 


s 0 = 

fix V \\ 


\l x i* y o)j • 


then conditions (2-a) and (2-b) are satisfied. For this case Equation (2.4-3) 
shows that (2-c) is satisfied. The reader can check that (2-d) and (2-e) are 
easily satisfied. 

Next we assume the theorem is true for the case n - 1 and show it holds 
for n. We divide the triangle into three parts ac shown in Figure (2.4.2). 
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(*o ' y„-i) ( x i ' yn-i) ( x o / y n ) 



Figure (2.4.2) 


Since the triangle has 


( 2 + n) ! 
2! n! 


inhomogeneous degree n independent points (Theorem (1.3.3) and Theorem (1.4.11)), 
it follows that condition (1) in Definition (2.4.1) is satisfied. Define 


Since 


B = 


{( x <r y n )’ ( x n * y 0 )’ ( x o- y 0 )} • 


det 


1 x n y 

0 J n 


1 x n y. 


y 0 


( x n~ x o) (yn _ y 0 ) 


/ o . 
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we see that B is inhomogeneouslv degree 1 independent. Furthermore from the 
definitions for B, S" ' 1 , S ? n ~ 1 and S 3 n " 1 , it follows that conditions (2-a), (2-b). 
and (2-c) are satisfied. To show condition (2— d) is valid, let (x t , y^) belong to 
S n but not Sj n "? The point (x^ y ^ lies on the straight line between (x 0 , y n ) and 
(x n , y 0 ); therefore the set 

{( x o’yJ K-y 0 ) ( x .- y,)} 

is inhomogeneous degree 1 dependent. Therefore, (x t . y^ is an inhomogeneous 
degree 1 combination of B - {(x 0 , y 0 )} which proves (2-d). Condition (2-e) 
follows from the induction hypothesis. ^ 

The following theorem shows a non- singular linear transformation of an 
acceptable set is acceptable. For a proof we refer the reader to Thacher's 
paper ([18], p. 621, 622). 

Theorem (2.4.4 ): Let Tbe a non-singular linear transformation. Then the 
sets {x.} and Tx.} are both (homogeneoi sly or inhomogeneously) degree n de- 
pendent or degree n independent. 
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